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COMPUTER IMPLEMENTED METHOD AND SYSTEM FOR 
COMPUTING AND EVALUATING DEMAND INFORMATION 

Field of the Invention 

The invention is in the field of computer implemented methods and systems for 
computing and evaluating demand information in general, and demand information for 
perishable consumer items based on sales data including sellouts in particular. 

Glossary of Terms 

The following terms listed alphabetically together with their acronyms are 
employed in the description and claims of the present invention: 
Adjusted sales data 

Sales data with expected full demand (EFD) values replacing truncated sales values (S) 

at occurrences of sellouts. 

Availability 

The probability of fully satisfying the demand for a consumer item at an outlet under a 
given draw or, in other words, satisfying demand for the consumer item at the outlet 
without an occurrence of a sellout due to demand being at least equal to draw. 
Distribution policy 

Delivered quantities of a consumer item at each outlet of a supply chain supplying a 
multitude of outlets in accordance with a predetermined business strategy. 
Draw (D) 

An industry term referring to the delivered quantity of a consumer item to a particular 
outlet under a given distribution policy. 
Draw bounded sales (BS) 

Sales quantities for a consumer item which would be nominally recorded on the 
assumption that the consumer item is delivered in accordance with a recommended 
draw instead of an actual draw i.e. sales quantities disregarding hidden demand at 
occurrences of sellouts. 
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Draw bounded returns (BR) 

Returns of a consumer item which would be nominally recorded on the assumption that 
the consumer item is delivered in accordance with a recommended draw instead of an 
actual draw i.e. returns disregarding hidden demand at occurrences of sellouts. 
Draw bounded sellout (BSO) 

A sellout of a consumer item which would be nominally recorded on the assumption 
that the consumer item is delivered in accordance with a recommended draw instead of 
an actual draw but disregarding hidden demand at occurrences of sellouts. 
Draw bounded stockout (EST) 

A quantity of unsatisfied demand which would be nominally recorded on the 
assumption that the consumer item is delivered in accordance with a recommended 
draw instead of an actual draw i.e. quantity of unsatisfied demand disregarding hidden 
demand at occurrences of sellouts. 
Expected fall demand (EFD) 

The sum of the truncated sales value at the occurrence of a sellout of a consumer item at 
an outlet and the estimated hidden demand for the consumer item at the outlet at the 
occurrence of the sellout, namely, EFD=S+H. 
Expected returns (ER) 

Returns of a consumer item which would be recorded on the assumption that the 
consumer item is delivered in accordance with a recommended draw instead of an 
actual draw taking into account hidden demand at occurrences of sellouts, namely, 
ER=RD-ES, for comparison to returns (R) due to an actual draw. 
Expected sales (ES) 

Sales of a consumer item which would be recorded on the assumption that the consumer 
item is delivered in accordance with a recommended draw instead of an actual draw 
taking into account hidden demand at occurrences of sellouts, namely, ES=min(S+H, 
RD) for comparison to sales (S) due to an actual draw. 
Expected sellout (ESQ) 

A sellout of a consumer item at an outlet which would be recorded on the assumption 
that the consumer item is delivered in accordance with a recommended draw instead of 
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an actual draw taking into account hidden demand at occurrences of sellouts for 
comparison to a sellout (SO) due to an actual draw. 
Expected stockout (EST) 

Quantity of unsatisfied demand for a consumer item at an outlet at an occurrence of an 
expected sellout which would be recorded on the assumption that the consumer item is 
delivered in accordance with a recommended draw instead of an actual draw taking into 
account hidden demand at occurrences of sellouts for comparison to a stockout (ST) due 
to an actual draw. 
Hidden demand (H) 

The unknown stockout value for a consumer item at an outlet at an occurrence of a 
sellout. 

Mean demand value 

The expected value of demand for a consumer item at an outlet that occurs at a given 
point of time. 
Perishable consumer item 

A consumer item with a limited shelf life at the end of which it loses most, if not all, of 
its consumer value, and which is typically not replenished to prevent an occurrence of a 
sellout Perishable consumer items can include perishable goods, for example, fruit, 
vegetables, flowers, and the like, and non-perishable goods, for example, printed media 
publications, namely, daily newspapers, weeklies, monthlies, and the like. 
Recommended draw (RD) 

A recommended draw for a consumer item at an outlet for comparison to an actual draw. 
The recommended draw preferably is arrived at by forecasting demand and adding 
safety stock to provide a predetermined level of availability for the consumer item at the 
outlet 
Returns (R) 

An industry term referring to the number of unsold copies of a consumer item on non- 
sellout days, namely, R=D-S. 
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Safety Stock (SS) 

An industry term referring to the number of extra stock of a consumer item above a 
demand forecast required to provide a predetermined level of availability. The safety 
stock for a consumer item is typically rounded to the nearest integer 
Sellout (SO) 

An industry term referring to an occurrence of demand being equal or greater than a 
delivered quantity of a consumer item at an outlet, namely, SO=5(D=S) where 5 is a 
binary indicator function: 



Stockout (ST) 

The quantity of unsatisfied demand for a consumer item at an occurrence of a sellout 
The stockout for a perishable consumer item is typically unknown and therefore 
stockout and hidden demand for such a consumer item are the same, namely, ST=H. 

Background of the Invention 

One computer implemented approach for computing demand forecast 
information for a demand forecast application involves defining a so-called demand 
forecast tree capable of being graphically represented by a single top level node (00) 
with at least two branches directly emanating therefrom, each branch having at least one 
node, for example, bottom level node (11) (see Figure 1). The demand forecast 
information is computed on the basis of time series of observations typically associated 
with bottom level nodes by a forecast engine capable of determining a mathematical 
simulation model for a demand process. One such forecast engine employing statistical 
seasonal causal time series models of count data is commercially available from 
Demantra Ltd, Israel, under the name Demantra™ Demand Planner. 

One exemplaiy demand forecast application is the media distribution problem, 
namely, detemiining the number of copies of a daily newspaper to be delivered daily to 
an outlet to minimize two mutually conflicting indices commonly quantified for 
evaluating the efficacy of a distribution policy for a newspaper over an evaluation 
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period: the frequency of sellouts, and the number of returns typically expressed in 
percentage terms of total returns over total draw. In this connection, it is a common 
practice in the industry that a draw for a newspaper at an outlet for a given day is greater 
than its demand forecast at that outlet for that day so to reduce the probability of a 
sellout but with the inherent downside that the probability of returns is greater. In the 
case of distribution systems for newspapers, the safety stock is typically intended to 
provide a level of safety of around 80±10% for a given probability function for the 
demand for the newspaper at the outlet. 

The media distribution problem is a particular realization of the well-known 
single period stochastic inventory problem which has been the subject of considerable 
academic interest It has been long recognized that occurrences of sellouts downwardly 
bias demand forecasts due to actual sales data reflecting stock availability levels as 
opposed to true demand. In view of this, researchers in the area of demand forecasting 
have developed procedures to cater for presence of sellouts by computing demand 
forecasts on adjusted sales data One exemplary approach is set out in an article entitled 
"Forecasting demand variation when there are stockouts", Bell, P.C., Journal of the 
Operational Research Society (2000) 51, 358-363. 

Summary of the Invention 

Conventional approaches for demand forecasting are based on the assumption 
that demand for a perishable consumer item is a stationary stochastic process, thereby 
rendering the estimating statistical moments of demand from historical sales data 
possible. Along these lines, conventional approaches assume that demand for a 
perishable consumer item may be successfully modeled by a Normal distribution, and 
that smoothing procedures may be employed for estimating demand at occurrences of 
sellouts to replace truncated sales values. Against this, the present invention is based 
on the notion that the demand process for a perishable consumer item at an outlet has a 
random but non-stationary nature, and thereby cannot be subjected to ensemble 
inferences based on a single realization thus negating the use of statistical moments to 
estimate parameters. Hence, in accordance with the present invention, the mean 
demand values for a perishable consumer item at an outlet over time are presupposed to 
be the outcome of a stochastic process which can be simulated by a forecast model 
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whilst actual sales for the perishable consumer item at the outlet over time is a 
particular realization of such a process but upper bounded by the draw at each point in 
time. Moreover, demand at a fixture point in time is a random variable with a 
conditional probability distribution conditioned on the forecasted mean demand value 
5 at that point in time. 

Based on this realization, the present invention proposes that hidden demand for 
a perishable consumer item at an occurrence of a sellout be preferably estimated by a 
single parameter conditional probability distribution whose parameter is the forecasted 
mean demand value determined by a forecast engine employing seasonal causal time 
10 series models of count data commercially available, for example, from Demantra Ltd, 
Israel The advantage of this approach is that it takes into account important 
information, for example, monthly and weekly seasonal variations, predictable and 
C! sporadic events, and the like, which is liable to be overlooked if such an approach is not 

Si employed. Moreover, it has been empirically found that demand for a wide range of 

15 perishable consumer items at an outlet is adequately modeled by a random variable X 
with a Poisson (X) conditional probability distribution conditioned on the forecasted 
mean demand value X, whereby the hidden demand at an occurrence of a sellout is 
given by: 
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H = E(X-D|X>D) = X 
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20 where f(-) is the Poisson probability distribution function, F(-) is the Poisson cumulative 
distribution function, and A, assumes the value of the mean demand value. Alternative 
single parameter conditional probability distributions may include inter alia 
exponential, geometric, and the like. It should be noted that the approach in accordance 
with the present invention precludes negative demand values which are inconceivable 

25 but theoretically possible in the case of the hitherto relied upon assumption that demand 
can be modeled by a Normal distribution. 

The present invention employs hidden demand not only to improve the accuracy 
of demand forecasting for perishable consumer items but also to generate important 
new performance metrics for more accurately evaluating the efficacy of a draw for a 

30 perishable consumer item at an outlet including inter alia estimated stockout over an 
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evaluation period, ratio of estimated stockout to draw, and the like. Moreover, the 
present invention employs hidden demand for more accurately comparing a 
recommended draw for a perishable consumer item at an outlet to an actual draw since 
draw bounded sales data as opposed to adjusted non draw bounded sales data 
compensating for hidden demand at occurrences of sellouts inherently prejudices 
against a recommended draw as will now become clear by way of the example below. 
In point of fact, there are five mutually exclusive and exhaustive cases which may 
possibly arise depending on Ihe values of a recommended draw, an actual draw and 
sales at each time point which each impact various performance metrics differently as 
summarized in the table of Figure 7. 

Assuming that the draw of a newspaper at an outlet was 30 copies of which 29 
were sold, a recommended draw of 33 copies would be unfavorably but fairly recorded 
with four returns as compared to the actual return of a single copy. But, if all 30 copies 
were sold, the recommended draw of 33 copies would be unfavorably recorded with 
three returns but this time unfairly since it belies the fact that in all likelihood at least 
one and possibly all three of the three returns would have been sold. Assuming that the 
hidden demand at the occurrence of the sellout occurring when all 30 copies were sold 
was, say, 2 copies, then the recommended draw of 33 copies would be unfavorably 
recorded with just one return but would be credited with two additional sold copies. 
But assuming that the hidden demand at the occurrence of the sellout was 4 copies, then 
the recommended draw of 33 copies would be unfavorably recorded with a sellout but 
with an additional three sold copies to its credit 

To summarize, the present invention facilitates improved forecasting at both at 
bottom level nodes and at higher level nodes, for example, say, at the level of a regional 
distributor. Moreover, the present invention provides for new more accurate 
performance evaluation techniques together with new performance metrics for 
evaluating an actual draw and for comparing a recommended draw to an actual draw. 
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Brief Description of the Drawings 

In order to better understand the invention and to see how it can be carried out in 
practice, a preferred embodiment will now be described, by way of a non-limiting 
example only, with reference to the accompanying drawings in which: 

Fig. 1 is a pictorial representation showing a demand forecast tree for computing 
demand forecast information for five different perishable consumer items; 

Fig. 2 is a table showing historical sales data associated with the demand 
forecast tree of Figure 1; 

Fig. 3 is a pictorial representation showing a computer implemented system for 
implementing the present invention; 

Fig. 4 is a flow chart showing the steps for calculating the hidden demand for a 
consumer item at an outlet at an occurrence of a sellout in accordance with the present 
invention; 

Fig. 5 is a graph showing the hidden demand for a newspaper at occurrences of 
sellouts over a month of sales as estimated in accordance with the present invention; 

Fig. 6 is a graph comparing the efficacy of an adjusted demand forecast against 
sales for the newspaper with the efficacy of an unadjusted demand forecast against sales 
for the newspaper for the same period of a month of sales; 

Fig. 7 is a table summarizing the five mutually exclusive and exhaustive cases 
which arise depending on the values of a recommended draw, an actual draw and sales 
for a perishable consumer item at an outlet for comparing the efficacy of a 
recommended draw against the efficacy of an actual draw; 

Fig. 8 is a graph showing a recommended draw for a newspaper for comparison 
with an actual draw and sales; and 

Figs. 9A-9C is a table enabling the comparison of the efficacy of a 
recommended draw for a newspaper for a month to that of the actual draw for the 
newspaper over the same month. 

Detailed Description of the Preferred Embodiment 

Figure 1 shows a demand forecast tree 1 having a single top level node (00) with 
five branches A, B, C, D and E for correspondingly representing the sale of Item I (top 
level-1 node (10)) at Locations 1 and 2 (bottom level nodes (11) and (21)), Item II (top 
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level-1 node (20)) at Locations 1 and 3 (bottom level nodes (21) and (23)), Item III (top 
level-1 node (30)) at Location 1, 2 and 3 (bottom level nodes (31), (32) and (33)), Item 
IV (top Ievel-1 node (40)) also at Locations 1, 2 and 3 (bottom level nodes (41), (42) 
and (43)); and Item V (top level-1 node (50)) at Location 1 (bottom level node (51)) 
only. Figure 2 shows an exemplary table 2 containing historical sales data of Item I at 
the bottom level nodes (11) and (12). Similar tables exist for the sale of the other items 
at their respective outlets. 

Figure 3 shows a computer implemented system 3 as illustrated and described in 
commonly assigned co-pending United States Patent Application No. 10/058,830 
entitled "Computer Implemented Method and System for Demand Forecast 
Applications 3 ', the contents are which are incorporated herein by reference, capable of 
implementing the present invention. The computer implemented system 3 includes a 
database server 4 for storing time series of sales values, a forecast engine 6 including 
two or more computer servers 7 each independently capable of computing demand 
forecast information for an entire branch of the demand forecast tree 1, and a computer 
manager 8 for allocating branches into tasks. 

The evaluation of the efficacy of a distribution policy for a perishable consumer 
item, say, a newspaper, at an outlet over an evaluation period, say, a month, in 
accordance with the present invention is now described with reference to Figures 4 and 
5. Sellouts of the newspaper at the outlet over the evaluation period are identified by 
comparing the number of sold copies (S) against draw (D) respectively shown as the 
solid graph line and the dashed graph line in Figure 5. The sales values excluding 
truncated sales values are input to a forecast engine, for example, the Demantra™ 
Demand Planner, commercially available from Demantra Ltd, Israel, to estimate mean 
demand values typically rounded to the nearest integer for the newspaper at the sellouts 
over the month shown as squares in Figure 5. The forecasted mean demand value at an 
occurrence of a sellout may be greater than, equal to or less than the sales at the sellout. 
For example, the forecasted mean demand value for Day 5 is 29 copies which is less 
than the draw of 33 copies whilst the forecasted mean demand value for Day 10 is 30 
copies which is greater than the sales of 28 copies. 
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Based on the assumption that demand for the newspaper is a random variable X 
with a Poisson conditional probability distribution conditioned on the forecasted mean 
demand value X, the hidden demand H at each sellout is estimated using the following 
expression 



For example, the hidden demand for Day 5 is 4 after having been rounded to the nearest 
integer based on the forecasted mean demand value A=29 and the draw D=33. The 
expected full demand EFD for the newspaper that could be expected to be sold at the 
outlet are then calculated at each occurrence of a sellout as follows: EFD=D+H (see 
crosses in Figure 5). Continuing the above example, the expected full demand for Day 
5 is 33+4=37 copies. The performance metrics for evaluating the efficacy of the 
distribution policy for the newspaper at the outlet over the evaluation period can include 
inter alia: the total hidden demand for the newspaper at the outlet over the evaluation 
period; the ratio of total hidden demand to total sales over the evaluation period; and the 
ratio of total hidden demand to draw over the evaluation period. In the present case, the 
total hidden demand for the newspaper is 19 copies which is equal to 2. 12% of sales and 
1.90% of draw. 

The adjusted sales data can be beneficially employed to improve demand 
forecasting as evidenced in Figure 6 in which an adjusted demand forecast derived from 
adjusted sales data yields a reduced MAPE=8.79% as opposed to the MAPE=12.10% of 
an unadjusted demand forecast derived from unadjusted sales data where: 



with the summation being over all the time points over a given period. 

The evaluation of the efficacy of a recommended draw for a perishable 
consumer item, say, a newspaper, at an outlet to an actual draw over an evaluation 
period, say, a month, in accordance with the present invention is now described with 
reference to Figures 7 to 9. The entries in the different columns of the table of Figure 7 
are derived from the following relationships: 




MAPE = 



]T | Actual Sales Values - Demand Forecast Values] 



xl00% 



J] | Actual Sales Values] 



ES=min(S+H,RD) 
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ER=RD-ES 

ESO=5(H+S>RD) 

EST=ESO*(S+H-RD) 

BS=min(S,RD) 

BR~RD-BS r =max (0, RD-S) 

BSO=5(RD<S) 

BST=max(0, S-RD) 

The four bias columns of Figure 7 show the biases in four performance metrics 
ES-BS, ER-BR, ESO-BSO and EST-BST which inherently exist by failing to take into 
account hidden demand at occurrences of sellouts, as particularly applies to Case 4. The 
four A columns of Figure 7 show the gains or losses in four performance metrics ES-S, 
ER-R, ESO-So and EST-ST by virtue of delivery of a consumer item to an outlet in 
accordance with a recommended draw as opposed to an actual draw. 

Turning now to Figures 8 and 9, the recommended draw (shown as a dashed line 
in Figure 8) is preferably arrived at by initially running a forecast engine on historical 
adjusted sales data to estimate a demand forecast for the newspaper at the outlet The 
hidden demand at the occurrences of sellouts is preferably estimated as described 
hereinabove with reference to Figures 4 and 5. Thereafter, safety stock is added to the 
demand forecast at each time point over the evaluation period in accordance with a 
predetermined availability percentage, say, 80%, typically rounded to the nearest integer 
to yield the recommended draw. 

The month evaluation period includes five occurrences of sellouts (shown as 
circles in Figure 7) on Days, 1, 9, 19, 21, and 28, namely, 16.13% sellouts, with total 
sales of 876 out of a total draw of 985 copies, namely, 11.07% returns. The present 
invention estimates that the hidden demand at the occurrences of the sellouts on Days, 
1, 9, 19, 21, and 28 is as follows: 5, 4, 5, 4, and 4, respectively, making for a total 
stockout of 22 copies which is the equivalent of 2.51% total sales and 2.23% total draw. 
The recommended draw would result in a lower draw of 960 copies as opposed to the 
actual draw of 985 copies but with only four occurrences of sellouts on Days 2, 8, 21, 
and 28. Not only is the recommended draw 2.54% lower than the actual draw but the 
recommended draw on taking into consideration the hidden demand at occurrences of 
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sellout would achieve 1.03% higher expected sales of 885 copies as opposed to actual 
sales of 876 copies and as opposed to draw bounded sales of just 871 copies if the 
hidden demand at occurrences sellouts would not have been taken into account. The 
recommended draw on taking into account the hidden demand at the occurrences of 
sellout would be expected to render 12.90% sellouts and 7.81% returns with Columns 
ES-R and ES-R in Figure 9 showing the gained sales and reduced returns achievable by 
the recommended draw in comparison to the actual draw. 

While the invention has been described with respect to a limited number of 
embodiments, it will be appreciated that many variations, modifications, and other 
applications of the invention can be made within the scope of the appended claims. 
Other inferior approaches may be employed for arriving at mean demand values not 
requiring a run of a forecast engine, for example, assuming that a mean demand value 
for a perishable consumer item at an outlet at an occurrence of a sellout is the truncated 
sales value. 



